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Abstract 

The aim of this paper is to show the interest in fitting features with an a-stable distribution to classify imperfect 
data. The supervised pattern recognition is thus based on the theory of continuous belief functions, which is a way to 
consider imprecision and uncertainty of data. The distributions of features are supposed to be unimodal and estimated 
by a single Gaussian and Of-stable model. Experimental results are first obtained from synthetic data by combining two 
features of one dimension and by considering a vector of two features. Mass functions are calculated from plausibility 
functions by using the generalized Bayes theorem. The same study is applied to the automatic classification of three 
types of sea fioor (rock, silt and sand) with features acquired by a mono-beam echo-sounder. We evaluate the quality 
of the a-stable model and the Gaussian model by analyzing qualitative results, using a Kolmogorov-Smirnov test (K-S 
test), and quantitative results with classification rates. The performances of the belief classifier are compared with a 
Bayesian approach. 

Keywords: Gaussian and cr-stable model, unimodal features, continuous belief functions, supervised pattern 
recognition, Kolmogorov-Smirnov test, Bayesian approach. 


1. Introduction 

The choice of a model has an important role in the problem of estimation. For example, the Gaussian model is 
a very efficient model which fits data in many applications as it is very simple to use and saves computation time. 
However, as is the case for all distribution models, Gaussian laws have some weaknesses and results can end-up being 
skewed. Indeed, as the Gaussian probability density function (pdf) is symmetrical, it is not valid when the pdf is not 
symmetrical. It is therefore difficult to choose the right model which fits data for each application. The Gaussian 
distribution belongs to a family of distributions called stable distributions. This family of distributions allows the 
representation of heavy tails and skewness. A distribution is said to have a heavy tail if the tail decays slower than the 
tail of the Gaussian distribution. Therefore, the property of skewness means that it is impossible to find a mode where 
probability density function is symmetrical. The main property of stable laws introduced by Levy HI is that the sum 
of two independent stable random variables gives a stable random variable, a-stable distributions are used in different 
fields of research such as radar (20, image processing 10 or finance lEllSl,... 

The aim of this study is to show the interest in fitting data with an O'-stable distribution. In Q, the author pro- 
poses to characterize the sea floor from a vector of features modeled by Gaussian mixture models (GMMs) using 
an Autonomous Underwater Vehicle (AUV). However, the problem with the Bayesian approach is the difficulty in 
considering the uncertainty of data. We therefore favored the use of an approach based on the theory of belief func¬ 
tions mill. In cni, the authors compared a Bayesian and belief classifier where data from sensors are modeled using 
GMMs estimated via an Expectation-Maximization (EM) algorithm mil- This work has been extended to data mod¬ 
eled by a-stable mixture models da. However, it is difficult to choose between these two models because the results 
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are roughly the same. This paper raises two problems. Firstly, it is necessary to work on a data set where features are 
modeled by a-stable pdfs. The second problem is to know how to apply the theory of belief functions when data from 
sensors are modeled by a-stable distributions. This point has been dealt with in ca. 

The recent characterization of uncertain environments has taken an important place in several fields of applica¬ 
tion such as the SOund Navigation And Ranging (SONAR). SONAR has therefore been used for the detection of 
underwater mines fl4l . In ca, the author developed techniques to perform automatic classification of sediments on 
the seabed from sonar images. In ifTOl . the authors classified sonar images by extracting features and modeling them 
with GMMs. In {TEl , the authors characterized the sea floor using data from a mono-beam echo-sounder. A data set 
represents an echo signal amplitude according to time. They compare the time envelope of echo signal amplitude with 
a set of theoretical reference curves. In this paper, we build a classifier based on the theory of belief functions where 
a vector of features extracted from a mono-beam echo-sounder is modeled by a Gaussian and an a-stable distribution. 
The feature pdfs have only one mode. We finally show that it would be interesting to fit features with an a-stable 
model. 

This paper is organized as follows: we first introduce the definition of stability, the method to construct a-stable 
probability density functions and the methods of estimation in Section The definitions in the multivariate case 
are also presented. We introduce the notion of belief functions in discrete and continuous cases in Section Belief 
functions are then calculated in the particular case of a-stable distributions and a belief classifier is constructed in 
Section]^ We finally classify data by modeling data with Gaussian and a-stable distributions before the generated 
data are classified by comparing the theory of belief functions with Gaussian and a-stable distributions in Section 
We compare the results obtained with the theory of belief functions using a Bayesian approach. 

2. The of-stable distributions 

Gauss introduced the probability density function called “Gaussian distribution” (in honor of Gauss) in his study 
of astronomy. Laplace and Poisson developed the theory of characteristic function by calculating the analytical ex¬ 
pression of Fourier transform of a probability density function. Laplace found that the Fourier transform of a Gaussian 
law is also a Gaussian law. Cauchy tried to calculate the Fourier transform of a “generalized Gaussian” function with 
the expression /„(v) = ^ Jq exp {-cf) cos (tx)dt, but he did not solve the problem. When the integer ^ is a real a, we 
define the family of a-stable distributions. However, Cauchy did not know at that time if he had defined a probability 
density function. With the results of Polya and Bernstein, Janicki and Weron fTTIl demonstrated that the family of 
a-stable laws are probability density functions. The mathematician Paul Levy studied the central limit theorem and 
showed, with the constraint of infinite variance, that the limit law is a stable law m . Motivated by this property. Levy 
calculated the Fourier transform for all a-stable distributions. These stable laws which satisfy the generalized central 
limit theorem are interesting as they allow the modeling of data as impulsive noise when the Gaussian model is not 
valid. Another property of these laws is the ability to model heavy tails and skewness. In the following, we define the 
notions of stability, characteristic function, the way to build a p^^from characteristic function, the different estimators 
of a-stable distributions and the extension of a-stable distribution to the multivariate case. 

2.7. Definition of stability 

Stability is when the sum of two independent random variables which follow a laws, gives an a law. Math¬ 
ematically, this definition means the following: a random variable X is stable, denoted X ~ if for all 

(a,b) € X there are c e and d eR such that: 


aXibX 2 = cXd, (1) 

with Xi and X 2 two independent a-stable random variables which follow the same distribution as X. If Equation 0 
defines the notion of stability, it does not give any indication as to how to parameterize an a-stable distribution. We 
therefore prefer to use the definition given by characteristic function to refer to an a-stable distribution. 
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2.2. Characteristic function 

Several equivalent definitions have been suggested in the literature to parameterize an a-stable distribution from 
its characteristic function |[T8l[T9l. Zolotarev nsi proposed the following: 




exp(7Y(5 - |yfr[l + il3X&n(—)sign{t){\t\ “ - 1)]) 

<Ps„(/3,y,S)(f) =1 2 

txpijt6 - \yt\[l + ip-sign{t)\og |f|]) 

TT 


if a ^ 1, 
if Of = 1, 


( 2 ) 


where each feature has specific values: 

• a g] 0, 2] is the characteristic exponent. 

• yS € [-1,1] is the skewness parameter. 

• ye represents the scale parameter. 

• d G M is the location parameter. 

The advantage of this parameterization compared to ifTSl is that the values of the characterization and probability 
density functions are continuous for all parameters. In fact, the parameterization defined by f\M is discontinuous 
when a = 1 and = 0. 

2.3. The probability density function 

The representation of an a-stable pdf denoted fs^{j 3 ,y, 6 )^ is obtained by calculating the Fourier transform of its 
characteristic function: 

X oo 

oo 

However, this definition is problematic for two reasons: while the integrand function is complex, its bounds are 
infinite. Nolan |[20ll therefore proposed a way to represent normalized a-stable distributions (f.e. y = I and d = 0). 
The main idea of Nolan (20) is to use variable modifications so that the integral has finite bounds. Each parameter 
has an influence on the shape of the fs^(fi,y,s)- The curve has a large peak when a is near 0 and a Gaussian shape when 
a = 2 (Figure The shape of the distribution skews to the left if J3 = 1, to the right if 13 = -1 (Figure 
while the distribution is symmetrical when = 0. Finally, the scale parameter enlarges or compresses the shape of the 
distribution (Figure pXc^ and the location parameter leads to the translation of the mode of the fs^(p,y,6) (Figure pXd^ . 

2.4. An overview of a-stable estimators 

The estimators of a-stable distributions are decomposed into three families: 

• the sample quantile methods 12111221 

• the sample characteristic function methods 123112411^1^ 

• the Maximum Likelihood Estimation Il771[^l29l[^ . 

Fama and Roll 1211 developed a method based on quantiles. However, the algorithm proposed by Fama and Roll 
suffers from a small asymptotic bias in a and y and restrictions on a g] 0.6, 2] and {3 = 0. McCulloch 1221 extended 
the quantile method to the asymmetric case (f.e. (3 = 0). The McCulloch estimator is valid for a g]0.6, 2]. 

Press (231 [24l proposed a method based on transformations of characteristic function. In (Ml . the author com¬ 
pared the performances of several estimators. For example, the Press method is efficient for specific values. Koutrou- 
velis t25\ extended the Press method and proposed a regression method to estimate the parameters of a-stable distri¬ 
butions. He proposed a second version of his algorithm which is distinct that it is iterative (26l. In (32l, the authors 
proved that the method proposed by Koutrouvelis is better than both the quantile method and the Press method because 
it gives consistent and asymptotically unbiased estimates. 

The Maximum Likelihood Estimation (MLE) was first studied in the symmetric case (7711^ . Dumouchel (29l 
developed an approximate maximum likelihood method. The MLE was also developed in the asymmetric case. 
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Nolan 1301 extended the MLE in general case. The problem with the MLE is the calculation of the a-stable proba¬ 
bility density function because there is no closed-form expression. Moreover, the computational algorithm is time- 
consuming. 

Consequently, we estimate a univariate Of-stable distribution using the Koutrouvelis method 1261 . 

2.5. Multivariate stable distributions 

It is possible to extend the a-stable distributions to the multivariate case. A random vector X e M is stable if for 
all (2, G there are c e and D g such that: 


aXx + bX2 = cX -r D, (4) 

where Xi and X2 are two independent and identically distributed random vectors which follow the same distribution 
as X. 

The characteristic function of an multivariate a-stable distribution, denoted X ~ Sa,d{o-, 5), has the form: 


^SaAcr,6){^) = ^ 


exp 

exp 


X 

X 


TIOC 

< t, s > 1^(1 - jsgn(< t, s >) tan(—)cr(j5') -r j < 6, i> 
'sd 2 


if a ^ 1, 


< t, s > 1(1 -h j-sgn(< t, s >)ln(< t, s >))(T{ds) -l- 7 < 5, t > | if a = I, 

'sd 2 


(5) 


with 


• = {v G M^|||x|| = 1} the J-dimensional unit sphere. 

• o"(.) a finite Borel measure on 5^. 

• 5,t G 


The expression for the characteristic function involves an integration over the unit sphere S^. The measure cr is called 
the spectral measure and 6 is called the location parameter. The problem with a multivariate a-stable distribution is 
that characteristic function forms a non-parametric set. To avoid this problem, it is possible to consider a discrete 
spectral measure which has the form: 

K 

o-(.) = 2]rA,(.), (6) 

i=\ 

with yi corresponding to weight and ^s^ the Dirac measure in si. Eor an a-stable distribution in M? with K mass points, 
the quantity si = {cos(^/), sin(^0} with Of = 

There are two methods to estimate an a-stable random vector: 


• the PROJection method O (PROJ) 

• the Empirical Characteristic Eunction method 1351 (ECE) 

These two algorithms have the same performances in terms of estimation and computation time. 

At this point, it is important to underline that the features extracted from mono-beam echo-sounders have the 
properties of heavy-tails and skewness. Consequently, we decided to estimate the data with an a-stable model. These 
data are however imprecise and uncertain: the imprecision and uncertainty of data can be linked to poor quality 
estimation of these data. To take these constraints into consideration, we used an uncertain theory called the theory of 
belief functions. Consequently, the goal of the next section is to present the theory of belief functions. 


3. The belief functions 

The final objective of this paper is to classify synthetic and real data using the theory of belief functions. Data 
obtained from sensors are generally imprecise and uncertain as noises can disrupt their acquisition. It is possible to 
consider these constraints by using the theory of belief functions. We will first develop the theory of belief functions 
within a discrete framework before characterizing it in real numbers. 
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3.1. Discrete belief functions 

This section outlines basic tools in relation to the theory of belief functions. 

3.1.1. Definitions 

Discrete belief functions were introduced by Dempster ||8l, and formalized by Shafer ||3| where he considers a 
discrete set of n exclusive events C/ called the frame of discernment: 

0 = (7) 

0 can be interpreted as all the assumptions to a problem. Belief functions are defined as 2® onto [0,1]. The objective 
of discrete belief functions is to attribute a weight of belief to each element A e 2®. Belief functions must follow the 
normalization: 

= ( 8 ) 

AC0 

where is called the basic belief assignment (bba). 

A focal element is a subset of A where m®(A) > 0 and several functions in one-to-one correspondence are built from 
bba: 


bef{A) 

= Y 

(9) 


BcA,B^(D 


pl®(A) 

= Y 

(10) 


AnB^d) 


q^iA) 

= Y 

(11) 


BC@,BDA 


The credibility function of A called bel® {A) is all the elements B Q A which believe partially in A. This function 
can be interpreted as a minimum of belief in A. On the contrary, a plausibility function pi® (A) illustrates the maximum 
belief in A while commonality function q®(A) represents the sum of bba allocated to the superset of A. This function 
is very useful as shown below. 

3.1.2. Combination rule 

We consider M different experts who give mass m®{i = 1,..., M) on each element A c 0. Alternatively, it is 
possible to combine them using combination rules. There are several combination rules fSEl in the literature which 
differently address conflicts between sources. The most common rule is the conjunctive combination lEl where the 
resultant mass of A is obtained by: 


M 

m®(A)= X ,VA€2®. 

BiC\...Bn=Ai^^ i=\ 


( 12 ) 


The mass of the empty set is given by: 

M 

m®(0)= Yj ,VAe2®. (13) 

This rule allows us to stay in the open world. However, this is not practical as calculations are difficult. It is possible 
to calculate resultant mass with communality functions where each mass m®{i = 1,..., M) must be converted into its 
communality function to calculate the resultant communality function as follows: 

M 

^®(A)= []^®(A). (14) 

The final mass is obtained by carrying out the inverse operation of Equation ([TT]( m 
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3.1.3. Pignistic probability 

To make a decision on 0, several operators exist such that maximum credibility or maximum plausibility with 
pignistic probability being the most commonly used operator |[38]| . This name comes from pignus, a bet, in Latin. 
This operator approaches the pair (bel,pl) by uniformly sharing a mass of focal elements on each singleton C/. This 
operator is defined by: 


betP(Ci) = Yj 

Ac@,Ci€A 


m®(A) 

|A|(1 -OT®(0))’ 


(15) 


where |A| represents the cardinality of A. 

We choose the decision C, hy evaluating max betP{Ck). 

l<k<n 


3.2. Continuous belief functions 

The basic description of continuous belief functions was accomplished by Shafer 0, then by Nguyen 1391 and 
Strat |40l. Recently, Smets Ell extended the definition of belief functions to the set of reals M = M U {-oo, +oo} and 
masses are only attributed to intervals of M. 

3.2.1. Definitions 

Let us consider I = {[x,y], (x,y], [x,y), (v,y); v,y e M} as a set of closed, half-opened and opened intervals of M. 
Focal elements are closed intervals of M. The quantity m^{x,y) are basic belief densities linked to a specific pdf. If 
V > y, then m^{x,y) = 0. With these definitions, it is possible to define the same functions as in the discrete case. The 
interval [a, b] being a set of M with a < /?, the previous functions can be defined as follows: 


bef{{a, b]) 

^x=b ny^b 

= 1 1 m^(x,y)dydx, 

Jx=a Jy=x 

(16) 

/>/*([«, b]) 

^x=b ^y=+oo 

= 1 1 {x,y)dydx, 

Jx=-oo Jy=max(a,x) 

(17) 

q\[a,b]) 

^x=a py=+oo 

= 1 1 m^{x,y)dydx. 

%J x=—oo *Jy=b 

(18) 


3.2.2. Pignistic probability 

The definition of pignistic probability for a < /? is: 


Betf([a, b]) 


^X=+oo ^y=+oo 

Jx=-oo Jy=. 


\[a,b]n[x,y]\ j 
----- m (x,y)dxdy. 

\[x.y]\ 


(19) 


It is possible to calculate pignistic probabilities to have basic belief densities. However, many basic belief densities 
exist for the same pignistic probability. To resolve this issue, we can use the consonant basic belief density. A basic 
belief density is said to be “consonant” when focal elements are nested. Focal elements 4 can be labeled as an index 
u such that 4 ^ I'u with u' > u. This definition is used to apply the least commitment principle, which consists in 
choosing the least informative belief function when a belief function is not totally defined and is only known to belong 
to a family of functions. The least commitment principle relies on an order relation between belief functions in order 
to determine if a belief function is more or less committed than another. For example, it is possible to define on order 
based on the commonality function: 


(VA c 0, ^f(A) < q®{A)) ^ (mf ). (20) 

The mass function m® is less committed than m® according to the commonality function. 

The function Betf can be induced by a set of isopignistic belief functions tB\so{Betf). Many papers ED Sana 
deal with the particular case of continuous belief functions with nested focal elements. For example, Smets BTIl 
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proved that the least committed basic belief assignment for the commonality ordering attributed to an interval 
I = [x,y] with y > V related to a bell-shaped [^pignistic probability function is determined by^ 

m\[x,y]) = 6(y)Sdx-^(y)X (21) 


with X = ^(y) satisfying = Betf{y) and 9{y)\ 


e(y) = {m-y) 


dBetfiy) 

dy 


( 22 ) 


The resultant basic belief assignment is consonant and belongs to the set B\so{Betf). However, it is difficult to 
build belief functions in the particular case of multimodal pdfs because the frame of discernment has connected sets. 
In ||44l[45l, the authors propose a way to build belief functions with connected sets by using a credal measure and an 
index function. 


3.3. Credal measure and index function 

In El, the authors propose a way to calculate belief functions from any probability density function. They use an 
index function / and a specific index space / to scan the set of focal elements T'. 

f-i ^ r, (23) 

y ^ f{y). (24) 

The authors introduce a positive measure jjP' such that £dju‘^(y) < 1 describes unconnected sets. The pair {f^jjP-) 
defines a belief function. For all A e fl, they define subsets which belong to the Borel set: 


r’cA 

= {y€l\f(y)CA], 

(25) 

FnA 

= {y€l\f(y)nAt@}, 

(26) 

F^a 

= {ye/|/(y)2A}. 

(27) 


From these definitions, they compute belief functions: 


beP(A) = 

dp%). 

(28) 


JFca 


pl^(A) = 

f dM^(y), 

(29) 


dPnA 


q^(A) = 

f dP^iy). 

(30) 


They continue their study by considering consonant belief functions. The set of focal elements T must be ordered 
from the operator c. They define an index function / from to such that: 

y > V ^ /(y) c f{x). 

They generate consonant sets by using a continuous function g from to I 

//, = (x e R‘‘\g{x) > a). 

They finally define the index function: 

//, :/=[0,a„,J ^ {//»|a€/}, (33) 

a ^ fi(a). (34) 


^Le. the pdf is unimodal with a mode p, continuous and strictly monotonous increasing (decreasing) at left (right) of the mode, 
refers to the Dirac’s measure. 


(31) 

= [0, a^axL The a-cuts are the set: 

(32) 
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The information available is the conditional pignistic density Betf. However, many basic belief densities exist for the 
same pignistic probability Betf. The least commitment principle allows the least informative basic belief density to 
be chosen, where the focal elements are the cr-cuts of Betf such thatj^ 

d^i^^y){a) = X{f^^{a))dA{a). (35) 


4. Continuous belief functions and a-stable distribution 

In this section, we model data distributions as a single Of-stable distribution. We must however introduce the 

notion of plausibility function for an a-stable distribution. We first describe how to calculate the plausibility function 

— —d 

knowing the pdf in M before we extend to in M . We finally explain how we construct our belief classifier. 


4.1. Link between pignistic probability function and plausibility function in M 

The information available is the conditional pignistic density Betf{Ci\ with C/ G 6. The function Betf[Ci] is 
supposed to be bell-shaped for all cr-stable distributions (proved by Yamazato ll46ll ). 

The plausibility function from a mass is obtained by an integral of Equation ^22) between [x, -\-oo[: 

p/*[C,■](/) = (at) - (36) 

By assuming that Betf is symmetrical, an integration by parts can simplify Equation ( [3^ : 

_ p+oo 

pl\Ci\{I) = 2{x-n)Betf{x) + 2 I Betf{t)dt. (37) 

Jx 

Now let us consider a particular case where symmetrical Betf is an a-stable distribution (the parameter J3 = 0). We 

f'+OO 

already know that Betf{x) = fsa{fi,y,6){^)- We can calculate Betf(t)dt by using the Chasles’ theorem: 


X +oo 

oo 




fsaifi,y,5)(f)dt. 


(38) 


By definition, a pdf has the quantity fsa(fi,y,d)0)dt = 1 and fsa{fi,y,6)if)dt represents the definition of the 
a-stable cumulative density function Fs^{fi,y,6). 

Consequently, Equation ( [TT] ) can be simplified: 


pl^[Ci](I) - 2(X - p)fs^(fi,y,S)(^) + 2(1 - Fs^(fi,y,d)(^))- 


(39) 


The plausibility function related to an interval I = [x, y] can also be seen as the area defined under the Ofcwrcut such 
that acut = Betf{x). The notation pl[Ci](x) is equivalent to pl[Ci](I). 

Now us let consider an asymmetric cr-stable probability density function. We must proceed numerically to cal¬ 
culate plausibility function at point xi > p, with p the mode of the probability density function (Eigure |^. The 
plausibility function related to an interval I\ = [xi,yi] is defined by the area defined under the acurcnt such that 
acut = Betf(xi): 

X Xl p+OO 

Betf{t)dt + (yi-xi)Betf(xi)+ I Betf{t)dt. (40) 

oo 4y\ 

By definition, a pdf has the quantity y fs„(p,y,s){t)dt = 1 - Fs„(p,y,s)(y],) and j_^fs,(p,y,s)(t)dt = Fs„(i 3 ,y,s)(xi). In 
general, we know only one point yi. We estimate numerically xi such that fs^(j 3 ,y, 6 )(yi) = /5^(/5,y,(5)(-^i)- Einally, the 
plausibility function related to the interval f is: 


p/*[C,](/i) = 1 + Fs„(p,y,s)(xi) - F(yi) + (yi- xi)/(xi). 


(41) 


refers to the Lebesgue’s measure. 
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In practice, we base the classification on several features defined for different classes 0 = {Ci,C„}. For example, 
the Haralick parameters “contrast” and “homogeneity” have different values for the classes rock, silt and sand. The 
features are modeled by a probability density function because the features have continuous values. We can calculate 
a plausibility function related to its probability density functions by using the least commitment principle. Several 
plausibility functions associated to the same feature can be combined by using the generalized Bayes theorem Ell HU 
to calculate mass functions allocated to A of an interval /: 

m“[x](A) = Y\ plM) FI (42) 

CjeA C jeA^ 

For several features, it is possible to combine the mass functions with combination rules. 

To validate our approach, we classify planes using kinematic data as in Eziiia and compare the decision with the 
approach of Caron et al ||43]| . We associate a Gaussian probability density function for each speed’s target (Figurej^: 

• Commercial defined by the probability density function of speed 5 2 ( 0 , 8,722.5). 

• Bomber defined by the probability density function of speed 5 2 ( 0 ,7,690). 

• Fighter defined by the probability density function of speed S 2 ( 0 ,10,730). 

We can observe that the decision is the same with the both approaches in the particular case of Gaussian probability 
density functions. 


4.2. Link between pignistic probability function and plausibility function to M 

_ d 

It is possible to extend plausibility function in M . In 1431 . the authors calculate plausibility function in the 
Gaussian situation of mode 6 and matrix of covariance H. Mass function is built in such a way that isoprobability 
surfaces Si with 1 < / < ^ are focal elements. In M?, isoprobability points of a multivariate Gaussian pdf of mean 


6 and covariance matrix H are ellipses. In dimension d, the authors defined focal elements as the nested sets HVa 
enclosed by the isoprobability hyperconics HCa = {x e M^|(x - ^) ^11“ ^(x - ^)}. They obtain bbd by applying the least 


commitment principle: 




a 2 


)^T-rd+2 


r(^) 


■ exp with a > 0. 


(43) 


Equation ( |4^ defines a;^^ distribution with J + 2 degrees of freedom. The plausibility function at point x belonging 
to a surface St corresponds to the volume delimited by St (we give an example in Figure]^ for an a-stable pdf). 
Consequently, the plausibility function at point x is defined by: 


pF (x 6: 


£ =+00 

(x-6)(x-( 


a 2 


d+Z 1 


(x-5) 2Tr(df) 


■ exp (--a)da. 


(44) 


Equation ( |44| ) can be simplified by: 


pF (X € = 1 - Frf+ 2 ((x - .5)(i:)-‘(x - .5)). (45) 

The function Fj +2 is a cumulative density function of the distribution with J + 2 degrees of liberty (d is the 
dimension of vector x). 

The authors also calculate plausibility functions in the particular case of GMMs with their pdfs denoted by Pgmm'- 


k=n 

PgmmOO = ^ (x, 6k, H^), (46) 

k=l 

where N(x, 6k, '^k) is the normal distribution of the k components with mean 6k and matrix of covariance Hk and 
Wk is the weight of each mixture. They assign belief to nested sets belonging to a component. Consequently, the 
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plausibility function of the GMMs can be seen as a weighted sum of plausibility functions defined by each component 
of the mixture: 

—d 

pf (X e = 1 - w,Frf+2((x - - S,)). (47) 

k=l 

We want to extend the calculation of plausibility function for any a-stable pdf. However, there is no closed-form 
expression for a-stable pdf. We use the approach developed by Dore et al. |[44l to build belief functions. 


4.3. Belief classifier 

Let us consider a data set with N samples from d sensors. For example, each feature of a vector x e can 
be seen as a piece of information from a sensor. The classification is divided into two steps. N x p (with p g] 0, 1[) 
samples are first picked out randomly from the data set for the learning base, noted X, such that: 






Nxp\ 


Nxp 


All columns of X belong to a class Q with 1 < i < n. Probability density functions (Gaussian or a-stable models) 
are estimated from samples belonging to classes. The rest of the samples is used for the test base (N x (I - p) 
vectors). We use a validation test to determine if samples belong to an estimated model. If the test is not valid, we 
stop the classification, otherwise we continue the classification (Figure |^. The classification step diagram in one and 
d dimensions is shown in Figure 

Plausibility functions knowing classes for x are calculated either from their probability density functions by using 
Equation ( |4T] ) for an unsymmetric a-stable probability density function or by using Equation ( [45] ) for a Gaussian 
probability density function. We obtain d mass functions (one for each feature) at point x with the generalized Bayes 
theorem ||47l|48l (Equation (|42|)). These d mass functions are combined by a combination rule to obtain a single mass 
function (section [3.1.2| ). Finally, the mass function is transformed into pignistic probability (Equation ( p^ ) to make 
the decision. 

It is also possible to work with a vector x of J dimensions. For an a-stable probability density function, plausibility 


functions are calculated for each feature by using the approach of Dore et al ll44l (section For a Gaussian 
probability density function, we use Equation ( [45] ) to calculate plausibilty functions. We calculate one mass function 
at point X by using the generalized Bayes theorem (Equation (|4^). There is no combination step because we are 
calculating a single mass function. We use Equation ( p^ to transform the mass function into pignistic probabilities. 
The decision is chosen by using the maximum number of pignistic probabilities. 


5. Application to pattern recognition 

The aim is to build a belief classifier and to perform a classification of synthetic and real data by estimating 
features using a Gaussian and a-stable pdf. In IT^ . synthetic data are classified by modeling features using Gaus¬ 
sian and Qf-stable mixture models. By observing confidence intervals, the hypothesis of a-stable mixture models is 
significantly better than the hypothesis of Gaussian mixture models. However, when the number of Gaussian distribu¬ 
tions increases, classification accuracies are significantly the same. Images from a side-scan sonar are automatically 
classified by extracting Haralick features ||49l|50l. However, classification accuracies are roughly the same. 

In this section, we limit algorithms with a vector of features in dimension d < 2. Indeed, the generalization of 
a-stable pdf in dimension d > 2 increases CPU time because there is no closed-form expression. Consequently, we 
distinguish two cases during the classification step: 

• The one dimension case: each dimension is considered as a feature. 

• The two case: we considered a vector of two features. 
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We also use a statistical test called Kolmogorov-Smirnov test (K-S test) to evaluate the quality of each model. A 
Kolmogorov-Smirnov test (K-S test) with a significance level of 5 % is also used to determine if two datasets differ 
significantly. Let us assume two null hypotheses: 

• H\ \ “Data follow a Gaussian distribution”. 

• H 2 '. “Data follow an a-stable distribution”. 

The notation Hi and if 2 are used for the rest of the paper. If the test rejects a null hypothesis if/, we stop the 
classification. Otherwise, if the test is valid, we then classify the samples belonging to the test base by using the belief 
classifier. 

The results obtained with the belief functions are compared using a Bayesian approach. The prior probability p(Ci) 
is first calculated corresponding to the proportion of each class in the learning set. For each class, the application of 
Bayes theorem gives posterior probabilities: 


p(Ci/x) = 


p(xlCi)p(Ci) 

n 

L p(^/Cu)piCu) 

u=l 


(48) 


Finally, the decision is chosen by using the maximum nimber of posterior probabilities. 

We first present a classification of synthetic data, belonging to Gaussian distributions, by modeling features using 
a Gaussian distribution and a-stable pdf. We then compare the a-stable and Gaussian model with synthetic data 
belonging to Of-stable distributions. The same approach is finally applied to real data from a mono-beam echo-sounder. 


5.1. Application to synthetic data generated by Gaussian distributions 

In this subsection, we show that the a-stable and Gaussian model have the same behavior during the classification 
when synthetic data are generated by Gaussian distributions. 


5.1.1. Presentation of the data 



P 

y 

First Gaussian pdf {Ci) 


/2\ 

VI 



• cn 

■-- 


Second Gaussian pdf(C2) 


/i\ 

w 



1 3 1.5) 
[1.5 1 j 


Third Gaussian pdfiCf) 

( 


L 

1 

(-) 

1 


Table 1: Numerical values for the Gaussian pdf. 


We simulated three Gaussian pdf^ in M x M {c.f Table [^. Each distribution holds 3000 samples. A mesh between 
[-4,4] X [-4,4] enables the level curves of pdf to be plotted (Figure [^. 

5.1.2. Results 

We generated data and split samples randomly into two sets: one third for the learning base and the rest for the 
test base. The learning base was used to estimate each mean and variance for the Gaussian distributions and each 
parameter a, JS, y and S for the a-stable distributions EISlISIl. We needed to make a mesh between [-4,4] x [-4,4] 
to calculate plausibility functions in M? with the a-stable model. Consequently, samples were chosen possessing 
features with dimensions within [-4,4]. 
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Hi 

Hi 

p-value 

ksstat 

p-value 

ksstat 

Cl 

first feature 

0.7021 

0.0542 

0.9241 

0.0422 

second feature 

0.8799 

0.0452 

0.9241 

0.0422 

C 2 

first feature 

0.8693 

0.0464 

0.3736 

0.0712 

second feature 

0.6855 

0.0557 

0.3736 

0.0712 

C 3 

first feature 

0.8437 

0.0464 

0.4150 

0.0667 

second feature 

0.6602 

0.0551 

0.7866 

0.0493 


Table 2: Statistical values for a Kolmogorov-Smirnov test with a significance level of 5 % (p-value: the critical value to reject the null hypothesis, 
ksstat: the greatest discrepancy between the observed and expected cumulative frequencies). 


The one dimension case. 

For each class C/, we consider each feature as a source of information. The estimated probability density functions 
can be seen as pignistic probability functions. For each pignistic probability function, we associate a mass function 
which will subsequently be combined with other mass functions. 

The K-S test is valid for the two null hypotheses Hi and H 2 (Table |^. We can assert that samples are drawn 
from the same distribution. The proposed method performs well in the particular case of synthetic data belonging to 
Gaussian distributions. However, the classification rates (Table are very low because there is confusion between 
classes (Figure [^. The classification accuracy obtained with the Bayesian approach is significantly the same as 
the belief functions. Indeed, the Bayesian performs well provided that the probability density functions are well- 
estimated. The classification results depend on the prior probabilitiy estimation: if a prior probability of a class is 
underestimated, the confusion between classes increases. 

We extended our study to a vector of two dimensions to try to improve the classification rate. 

The two dimension case. 

We generalized the study by considering a vector of two features. The learning base was used to estimate each mean 
and matrix of covariance for the Gaussian distributions (Figure and each parameter a, (r, 6 and 6 for the a-stable 
distributions (Figure [T^. 

As in one dimension, the two null hypotheses Hi and H 2 were verified (Table|^. The classification results (Tablel^ 
are somewhat less than impressive because there is confusion between classes (between Ci and C 2 cf. Figure 0. 
Furthermore, the work in two dimensions enables better results to be obtained than the combination. The Bayesian 
approach gives significantly the same results as the theory of belief functions. Indeed, the estimations of model and 
the estimation of prior probabilities are well-estimated. 

We extended our study by considering synthetic data generated by a-stable distributions. 



Bayesian approach 

Belief approach 

Classification accuracies (%) 

95 % confidence intervals 

Classification accuracies (%) 

95 % confidence intervals 

Hi 

1 dimension 

66.19 

[65.13,67.25] 

66.76 

[65.71,67.81] 

2 dimensions 

76.14 

[75.19,77.09] 

75.35 

[74.39,76.31] 

Hi 

1 dimension 

66.25 

[65.19,67.31] 

67.15 

[66.10,68.20] 

2 dimensions 

76.31 

[75.36,77.26] 

74.50 

[73.53,75,47] 


Table 3: Classification accuracies and 95 % confidence intervals. 


5.2. Application to synthetic data generated by a-stable distributions 

In this subsection, we show the interest in modeling features in one and two dimensions with a single a-stable 
distribution. 
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Hi 

Hi 

p-value 

ksstat 

p-value 

ksstat 

Cl 

0.1509 

0.0873 

0.1509 

0.0873 

Cl 

0.0490 

0.0650 

0.1997 

0.0836 

C 3 

0.1399 

0.0870 

0.1665 

0.0841 


Table 4: Statistical values for a Kolmogorov-Smirnov test with a significance level of 5 % (p-value: the critical value to reject the null hypothesis, 
ksstat: the greatest discrepancy between the observed and expected cumulative frequencies). 



a 

(T 

e 

6 

First a-stable pdfiCi) 

1.5 

1 

1 

1 


1 




Second a-stable pdf(C 2 ) 

1.5 

C) 

1 

1 

(?) 

1 

( 

' 2 ' 

il-4 

I 

Third a-stable pdf{Cf) 

1.5 

C) 

1 

1 

(?) 

1 

( 

' 1 ' 

i0-5, 

I 


Table 5: Numerical values for the a-stable pdf. 


5.2.1. Presentation of the data 

Three classes of artificial data sets were generated from 2D a-stable distributions (c.f. Table and 1(5^ for 
the significance of cr and 6) with 3000 samples. A mesh between [-4,4] x [-4,4] enables the level curves of pdf io 
be plotted (Figure pT]). 

5.2.2. Results 

The one dimension case. 

We can assert that the estimation with the a-stable hypothesis is better than the Gaussian hypothesis (Figure 
There is a difference between the mode of the Gaussian model and the mode of a-stable model. Indeed, the mean, 
calculated from samples, for the Gaussian model does not correspond to the mode when samples do not belong to a 
Gaussian law. Moreover, the values of pdf^ are not the same compared to the real pdf^. 



p-value 

ksstat 

Cl 

first feature 

0.1758 

0.0851 

second feature 

0.7614 

0.0517 

C 2 

first feature 

0.8487 

0.0458 

second feature 

0.4794 

0.0630 

C 3 

first feature 

0.5505 

0.0621 

second feature 

0.2753 

0.0776 


Table 6: Statistical values for a Kolmogorov-Smirnov test with a significance level of 5 % (p-value: the critical value to reject the null hypothesis, 
ksstat: the greatest discrepancy between the observed and expected cumulative frequencies). 


The K-S test is not satisfied for the null hypothesis Hi for each class and each component. Consequently, we 
stopped the classification step for the Gaussian model. However, the K-S test is valid for the null hypothesis H 2 
(Table [^. We can observe that the results obtained with the theory of belief functions are significantly the same as the 
results obtained using the Bayesian approach. This phenomenon can be explained by the fact that prior probabilities 
were well-estimated. Consequently, we changed voluntarily the values of prior probabilities. We fixed arbitrarily the 
prior probabilities: p{Ci) = 1/6, p{C2) = 2/3 and p{Cf) = 1/6. The classification accuracy decreased to 53.10 % 
(Table [7]). Indeed, the learning base and the test base can sometimes be significantly different. For example, the 
prior probability of class sand can be greater than the prior probabilities of classes rock and silt, although it does not 
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represent the truth, and the classification rate of class sand can be favoured. This phenomenon introduces confusion 
between classes and the classification rate can decrease. Consequently, the learning step is an important step for the 
Bayesian approach and can have a bad effect on the classification rate whereas the theory of belief functions is less 
sensitive to the learning step. 



Bayesian approach 

Classification accuracies (%) 

95 % confidence intervals 

Hi 

1 dimension 

55.26 

[54.15;56.37] 

2 dimensions 

53.10 

[51.98;54.22] 


Table 7: Classification accuracies and 95 % confidence intervals with the prior probabilities p{C\) = 1/6, pfCi) = 2/3 and pfCs) = 1/6. 


The two dimension case. 

We considered a vector of two features. In Figurewe draw the iso-contour lines of data estimated with the Gaus¬ 
sian model and in Figurethe iso-contour lines of data estimated with the a-stable model 

As in one dimension, the null hypothesis Hi is rejected at significance level 5 %, but the null hypothesis H 2 is valid 
(Tabled. 

The classification results (Table are somewhat less than impressive because there is confusion between classes. 
Furthermore, we obtain the same classification accuracies with the vector of two dimensions compared to the com¬ 
bination of two features. However, the classification decreases when the prior probabilities are not well-estimated 
(Table |7](. 

We also compared these results with a GMM. It is well-known that the GMM can accurately model an arbitrary 
continuous distribution. This model estimation can be performed efficiently using the Expectation-Maximization 
(EM) algorithm. We compared classification accuracies by increasing the number of components. We drew the 
classification accuracy (Figure p~5)) in relation to the number of components. Let us assume the null hypothesis: 

• G„: “Data follow a Gaussian mixture model with n components”. 

The K-S test rejects the null hypothesis G„ for a number of components n < A. The representations of iso-contour 
lines (Figure Figure [T^ and Figure confirm the K-S test. Furthermore, the classification accuracies are lower 
than classification rates with a single a-stable pdf. 

However, we can not increase indefinitely the number of components because a phenomenon of overfitting can 
appear (for example the representation of iso-contour by using a GMM with 5 components). Consequently, the number 
of 4 components seems to be a good compromise between the overfitting and good estimation. The classification 
accuracies are roughly the same between the single a-stable model and the GMM with 4 components. 



p-value 

ksstat 

Cl 

0.0683 

0.1003 

Cl 

0.3694 

0.0688 

C 3 

0.1154 

0.0932 


Table 8: Statistical values for a Kolmogorov-Smirnov test with a significance level of 5 % (p-value: the critical value to reject the null hypothesis, 
ksstat: the greatest discrepancy between the observed and expected cumulative frequencies). 


5.3. Application to real data from a mono-beam echo-sounder 
5.3.1. Presentation of data 

We used a data set from a mono-beam echo-sounder given by the Service Hydrographique et Oceanique de la 
Marine (SHOM). Raw data represents an echo signal amplitude according to time. In IT^ . the authors classify seven 
types of sea floor by comparing the time envelope of echo signal amplitude with a set of theoretical references curves. 
In our application, raw data (Figure[^ were processed using the Quester Tangent Corporation (QTC) software |[5^ to 
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Bayesian approach 

Belief approach 

Classification accuracies (%) 

95 % confidence intervals 

Classification accuracies (%) 

95 % confidence intervals 

H2 

1 dimension 

66.56 

[65.51;67.62] 

66.49 

[65.44;67.55] 

2 dimensions 

66.05 

[64.99;67.11] 

65.16 

[64.08;66.22] 


Table 9: Classification accuracies and 95 % confidence intervals. 


obtain some features, which were normalized between [0,1]. These data had already been used for the navigation of an 
Autonomous Underwater Vehicle (AUV) (Ml- The frame of discernment is 0 = {silt, rock, sand}, with 4853 samples 
from silt, 6017 from rock and 7338 from sand. The selection of features plays an important role in classification 
because the classification accuracy can be different according to the features. In Ea, the author gave an overview of 
methods based on features to classify data and choose features which discriminate all classes. Some features calculated 
by the QTC software can be modeled by an a-stable pdf. There is a graphical test called converging variance test 1561 
which enables us to determine if samples belong to an a-stable distribution. This test calculates the estimation of 
variances by varying the number of samples. If the estimation of variance diverges, the samples can belong to an 
a-stable distribution. We give an example of this test for the feature called “third quantile calculated on echo signal 
amplitude” of the class rock (Figure [^. We chose the features called the “third quantile calculated on echo signal 
amplitude” and the “25th quantile calculated on cumulative energy”. 

5.3.2. Results 

We randomly select 5000 samples for the data set. Half the samples were used for the learning base and the rest 
for the test base. We first consider features in one dimension, i.e. two mass functions were calculated and combined 
to obtain a single mass function. 

The one dimension case. 

We can observe that the assumption of the a-stable model can easily accommodate the data compared to the Gaussian 
model (Figure!^. 

The Of-stable hypothesis is valid with the K-S test whereas the K-S test rejects the Gaussian hypothesis (Table p^. 
The approach using the theory of belief functions (classification accuracy of 82.68 %) give better results than the 
Bayesian approach (classification accuracy of 80.64 %) but not significantly. This phenomenon can be explained by 
the fact that the estimated models and prior probabilities are well-estimated. 

The two dimensions case. 

We extended the study by using a vector of two features. The level curves of empirical data (Figureshow there is 
confusion between the class silt and the class sand. The a-stable model (Figure considers the confusion between 
classes compared to the Gaussian model (Figure [24|). 



p-value 

ksstat 

silt 

first feature 

0.2310 

0.0879 

second feature 

0.7240 

0.0586 

sand 

first feature 

0.1206 

0.0811 

second feature 

0.1419 

0.0788 

rock 

first feature 

0.5784 

0.0595 

second feature 

0.0599 

0.1012 


Table 10: Statistical values for a Kolmogorov-Smirnov test with a significance level of 5 % (p-value: the critical value to reject the null hypothesis, 
ksstat: the greatest discrepancy between the observed and expected cumulative frequencies.) 
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6. Conclusions 


In this paper, we have shown the advantages in using the Of-stable distributions to model data with heavy-tails. We 
considered the imprecision and uncertainty of data for modeling pdf and the theory of belief functions offers a way 
to model these constraints. We have examined the fundamental definitions of this theory and have shown a way to 
calculate plausibility functions when the knowledge of sensors is an a-stable pdf We finally validated our model by 
making a comparison with the model examined by Caron et al. 14^ where the pdf\^ a Gaussian. 

Synthetic and real data were finally classified using the theory of belief functions. We estimated the learning base, 
calculated plausibility functions, combined plausibility functions and calculated maximum pignistic probability to 
obtain the classification accuracy. The K-S test shows that synthetic data can be modeled by an a-stable model. The 
proposed method performs well for synthetic data. The consideration of two features improves the classification rate 
compared to the combination of two features for the Gaussian data. This study was then extended to a real application 
by using features extracted from a mono-beam echo-sounder. The Gaussian model is limited when modeling features 
compared to the a-stable model because the a-stable model has more degrees of freedom. To sum up, the interest in 
using an a-stable model is that data, in both one or two dimensions, can be modeled. The problem with the a-stable 
model is the computation time. Indeed, we proceed numerically to calculate plausibility functions (discretization for 
the bivariate a-stable pdf). Furthermore, it is difficult to generalize in dimension d > 2 without increasing CPU time. 

We present preliminary results about classification problem by modeling features with a-stable probability density 
functions in dimension J < 2. In future works, we plan to make experiments in the high-dimensional case with d> 3. 
One solution in perspective to improve the computation time is to optimize the code in another language such that 
C/C-I-I-. Another perspective to this work is the use of other features from sensors to improve the classification 
accuracy, images from side-scan sonar. 
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(a) Influence of parameter a with yS = 0, 7 = 1 and S = 0. (b) Influence of parameter with a = 1.5, y = 1 and S = 0. 




(c) Influence of parameter 7 with a = 1.5, j3 = 0 and (5 = 0. (d) Influence of parameter d with a = 1.5, j3 = 0 and 7 = 1 . 


Figure I: Different cr-stable pdf. 



Figure 2: Calculation of plausibility function with an unsymmetric a-stable distribution. 
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Figure 3: Representation of probability density function of speed and the pignistic probabilities calculated from the Fiche et al and Caron et 
al. ED approaches. 



Figure 4: Isoprobability surface of /. 
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Figure 5: Scheme of classification. 



Figure 6: Scheme of classification step in one and d dimensions. 
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Figure 7: Iso-contour lines of generated Gaussian pdf. 



Figure 8: Empirical /7<^and its estimations (The first row corresponds to the first feature and the second row corresponds to the second feature). 



Figure 9: Iso-contour lines of data estimated with a Gaussian model. 
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Figure 10: Iso-contour lines of data estimated with an cr-stable model. 



Figure 11: Iso-contour lines of generated u-stable pdf. 
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Figure 12: Empirical p<^and its estimations (The first row corresponds to the first feature and the second row corresponds to the second feature). 
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Figure 13: Iso-contour lines of data estimated with a Gaussian model. 



Figure 14: Iso-contour lines of data estimated with an cr-stable model. 
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Figure 15: Classification rates according the number of components. 
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Figure 16: Representation of iso-contour by modeling data with a mixture of Gaussian for the class Ci (from left to right: 2, 3, 4 and 5 components). 



Figure 17: Representation of iso-contour by modeling data with a mixture of Gaussian for the class C 2 (from left to right: 2, 3, 4 and 5 components). 
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Figure 18: Representation of iso-contour by modeling data with a mixture of Gaussian for the class C 3 (from left to right: 2, 3,4 and 5 components). 
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Figure 19: Example of echo signal amplitude from silt in low frequency. 



Figure 20: Running sample variances. 
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Figure 21: Empirical pJfand its estimations (The first row corresponds to the feature called “third quantile calculated on echo signal amplitude” 
and the second row corresponds to the feature called “25th quantile calculated on cumulative energy”). 





Figure 22: Level curves of three empirical cr-stable distributions with 10000 samples (The first column refers to the class rock, the second column 
refers to the class sand and the third column refers to the class silt). 
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Figure 23: Level curves with an a-stable model estimation (The first column refers to the class rock, the second column refers to the class sand and 
the third column refers to the class silt). 
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Figure 24: Level curves with a Gaussian model estimation (The first column refers to the class rock, the second column refers to the class sand and 
the third column refers to the class silt). 


28 



































